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DETAILED ACTION 

1 . This action is responsive to communications: amendment filed 1 1/28/06 to the 
application filed on 2/12/04. 

2. Claims 1-61 are pending in the case. Claims 1, 20. and 41 are independent 
claims. 

3. The objection of claim 1 5 remains since there is no amendment of claim 1 5. 

4. The 1 02 and 1 03 rejections of claims 1 -61 have been withdrawn in view of the 
amendment. 

Claim Objections 

5. Claim 1 5 remains objected to because of the minor error: the word "and" within 
"the selecting, moving, and deleting step comprises" (line 2) is not correct. It should be 
"or" to be suitable in the phrase. 

In order to indicate the alternatives according to Applicants, the word "or" should be 
used, not "and." But if "and" is used, then the word "step" should be in plural and 
"comprises" should be "comprise." . 

Claim Rejections - 35 USC §112 

6. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

7. Claims 1-19 are rejected under 35 U.S.C. 112, second paragraph, as being 
indefinite for failing to particularly point out and distinctly claim the subject matter which 
applicant regards as the invention. 
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Regarding independent claim 1 , it is confusing tliat the claim recites "where the anchor 
types, comment types and connector types are selected from a predetermined set of 
anchor types, comment types and connector types" (lines 8-9) since all three types are 
selected from a set of three types . It appears that Applicants mean one of the three 
types would be selected from the set, not all the three types are selected at a same 
time. 

Dependent claims 2-19 are rejected for fully incorporating the deficiencies of their base 
claim. 

Claim Rejections - 35 USC §103 

8. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

9. Claims 1-61 are rejected under 35 U.S.C. 103(a) as being unpatentable oyer 
Marshall et al. (US Pat App Pub No 2003/0070139, filed 9/16/02. priority 9/14/01) in 
yiew of Bargeron et al. (US 2004/0252888. 1 2/1 6/04. filed 6/1 3/03). 

Regarding independent claim 1, Marshall discloses: 

- reading and displaying a portion of a digital document on a screen based on one 
or more display properties of the screen (figures 3-4, [0037], [0038], [0028], 
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[0082]: displaying a portion of a digital document can be carried out on a 
personal computer with normal size display or on a handheld device implies the 
document is read to be displayed based on one or more properties of the screen) 

- accepting one or more freeform annotations on the displayed portion of the digital 
document via one or more input devices (figures 2-4, [0035], [0056]) 

- processing the one or more freeform annotations via a completely deterministic 
state machine ([0079]) 

Marshall does not disfclose: 

- generating one or more categorized annotations of the one or more free form 
annotations based one one or more of anchor types, comment types, and 
connector types where the anchor types, comment types and connector types 
are selected from a predetermined set of anchor types, comment types and 
connector types 

Bargeron discloses generating a logical anchor for each annotation 

- generating one or more categorized annotations of the one or more free form 
annotations based one one or more of anchor types, comment types, and 
connector types where the anchor types, comment types and connector types 
are selected from a predetermined set of anchor types, comment types and 
connector types ([0017], [0062], [0075]: generating annotation of anchor type 
where the anchor type is one of the types of the classified annotations) 

It would have been obvious to an ordinary skill in the art at the time of the invention was 
made to combine Bargeron into Marshall since generating annotations of anchor type, 
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which is classified, in Bargeron would provide the advantage to incorporate into 
Marshall to use the anchor annotation for processing one free form annotation to 
indicate the outcome of the annotation process. 

Regarding claim 2, which is dependent on claim 1, Marshall discloses that the method 
can be performed on one or more computing devices, wherein a computing device in 
the one or more computing devices can be one of: a PDA, a Tablet PC, a Pocket PC, a 
cell phone, an electronic message device, a Java-enabled device, a laptop or desktop 
PC, a workstation, and a mainframe computer ([0082]). 

Regarding claim 3, which is dependent on claim 1 , Marshall does not explicitly disclose 
that the method can be implemented in one or more of the following programming 
languages: C, C-I-+, Visual Basic, Java and Java Applet. 

However, it would have been obvious to one of ordinary skill in the art at the time of the 
invention was made to have modified Marshall to incorporate using one or more of 
programming languages C, C++, Visual Basic, Java and Java Applet to implement the 
method since th^se are well known programming languages to write a program. 

Regarding claim 4, which is dependent on claim 1, Marshall discloses that the digital 
document can include at least one of: a text file, an image, a figure, a drawing, a graph, 
a picture, and a video clip ([0037]). 
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Regarding claim 5, which is dependent on claim 1, Marshall discloses wherein a display 
properties in the one or more display properties of the screen can be associated with 
one of: a text font, a font size, a text color, a display width, height, and resolution of the 
screen ([0041]: the font characteristics are ones of the display properties). 
Regarding claim 6, which is dependent on claim 1, Marshall discloses wherein a 
freeform annotation in the one or more freeform annotations can be one or more of 
strokes, gestures and handwritings of any shape ([0047], [0048]). 

Regarding claim 7, which is dependent on claim 1, Marshall discloses wherein an input 
device in the one or more input devices can be one of a keyboard, a mouse, and a 
stylus (([0049], [0056]). 

Regarding claim 8, which is dependent on claim 1, Marshall discloses storing the digital 
document in memory and/or in a persistent storage ([0057]). 

Regarding claim 9, which is dependent on claim 1, Marshall discloses wherein the 
reading and displaying step comprises at least one of utilizing the control of the 
Microsoft Internet Explorer ^and accessing the Document Object Model to obtain the 
bounding box of the digital document ([0056]: the system for performing freeform 
annotations on documents using a connection over the Internet or intranet implies 
utilizing the control of a Internet browser such as Internet Explorer). 
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Regarding claim 10. which is dependent on claim 1, Marshall discloses reserving an 
area on the screen for the input of the one or more freefomri annotations ([0040]). 

Regarding claim 11, which is dependent on claim 1, Marshall discloses managing one 
or more annotation marks on the displayed portion of the digital document by 
performing at least one of: creating, selecting, modifying, moving, deleting, rendering, 
and displaying an annotation mark of the one or more annotation marks on the screen 
based on the one or more display properties of the screen ([0047]: writing marks with 
pen strokes shows creating annotation marks with a pen). 

Regarding claim 12, which is dependent on claim 11, Marshall discloses the annotation 
mark in the one or more annotation marks can be one of. 

- an anchor capable of associating with a part of the portion of the digital document 
[0035]-[0036]: the circle, underline, and asterik, which are annotation marks, 
associated with a portion of a document to indicate that the Importance of the 
portion, [0037]-[0038]) 

- a link capable of connecting at least two anchors 

- a comment capable of associating with either an anchor or a connector 
Regarding claim 13, which is dependent on claim 12, Marshall discloses that: 

- the anchor can be one of: an underline, a highlight, a circled word, a circled area, 
a bracket, and a margin bar ([0036], [0038]-[0039]) 

- the link can be one of: an arrow, and a connector ([0037], [0040]) 
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Regarding claim 14, which is dependent on claim 1, Marshall does not explicitly disclose 
storing the one or more annotation marks in memory and/or in a persistent storage. 
However, Marshall discloses detecting different types of annotation marks applied on a 
document ([0040]. This suggests that the annotation marks are stored in memory. 

Regarding claim 15, which is dependent on claim 11, Marshall does not explicitly 
disclose that the selecting, moving, modifying, or deleting step comprises: tapping, 
holding, and. lifting an input device in the one or more input devices on the annotation 
mark. 

However, Marshall does disclose creating annotation mark with pen strokes ([0047]). 
Therefore, it would have been obvious to an ordinary skill in the art at the time of the 
invention was made to modify Marshall to incorporate tapping, holding, and lifting an 
input device on the annotation mark since said tapping, holding, and lifting are "must do" 
actions when writing strokes on a document. 

Regarding claim* 16, which is dependent on claim 1 1 , Marshall discloses that the 
rendering step comprises at least one of. 

- retrieving a bounding box of the annotation mark ([0053]) 

- resizing and/or splitting the annotation mark 

- repositioning the annotation mark on the portion of the digital document under 
display 
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Regarding claim 17, which is dependent on claim 12, Marshall discloses: 

- reserving an area on the screen for the rendering of the comment ([0040]: writing 
marginalia implies that margin is reserved as an area to render a comment); 
and/or 

- resizing and/or repositioning the comment based on one of the one or more 
display properties 

Regarding claim 18, which is dependent on claim 12, Marshall discloses identifying the 
start of the comment by recognizing a freeform annotation in the one or more freeform 
annotations ([0040], [0042], wherein the freeform annotation is capable of starting on a 
blank area on the digital document under display ([0040]: the mark should be written on 
a blank area); and/or not intersecting with any word or image on the digital document. 

Regarding claim 19, which is dependent on claim 12, Marshall discloses: 

- identifying the finish of the comment by recognizing a freeform annotation in the 
one or more freefomi annotations [0040], [0047] wherein the freeform annotation 
can be one of: 

o a click on a predefined area on the screen, which can be a button 
o a circular gesture around the comment ([0047], [0053]: clustering of marks 
with encompassing boxes shows a circular gesture around the comment) 
o s strike-through gesture on the comment 
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Claims 20-21, 23-34, 37-40 are the system of method claims 1-2, 4-13, 16-19, and are 
rejected under the same rationale. 

Claims 22, 35-36 are the system of method claims 3, 14-15, and are rejected under the 
same rationale. 

Claims 41-42, 44-47, 49-54, 56-61 are the system of method claims 1-2, 4-13, 16-19, 
and are rejected under the same rationale. 

Claims 43, 48, and 55 are the system of method claims 3, 14-15, and are rejected under 
the same rationale. 

Response to Arguments 
10. Applicant's arguments filed 1 1/28/06 have been fully considered but they are not 
persuasive. 

Regarding independent claim 1 , Bargeron in combination with Marshall, discloses the 
amended feature. See the rejection. 

Regarding independent claims 20 and 41, the claims are the corresponding system 
claim and corresponding computer readable medium claim of method claim 1 . Since 
Bargeron discloses generating annotations, which are classified and grouped (figure 1, 
[0062]), Bargeron implies to include a component that is capable of classifying and 
grouping the annotations, which means equivalent to categorizing annotations. 
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Applicants further argue that IVIarshall does not disclose "processing the one or more 
freeform annotations via a completely deterministic state machine" since "the numerous 
annotation type that can be used by any user, certainly excludes only 'one meaning or 
interpretation" or "the continuum of responses for Yeader marking style' and the 
'frequency of the reader's marks' precludes processing by a deterministic finite state 
machine" (remarks, page 16). 
Examiner respectfully disagrees. 

It is possible that a numerous annotation types can be used by any user. However, only 
one type of annotations is applied to a particular text, not two types at a same time. 
Therefore, there is no exclusion of only one meaning or interpretation as argued. 
"The continuum of responses for 'reader's marking style' and the 'frequency of the 
reader's marks" do not preclude processing by a deterministic finite state machine" 
since as stated above, only one style of annotation is marked to a particular portion of 
text at a time by a user even though the frequency of marking regarding said annotation 
by said user can occur. Therefore, there is no preclusion of processing by a 
detemninsitic finite state machine. 

I\^arshall discloses that each input (condition) has a con'esponding output, not two 
([0038]). Thus, it is not ambiguous or indefinite. The state machine in IVIarshall, 
therefore, is deterministic finite state machine. 
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Conclusion 

1 1 . The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. 

Golovchinsky et al. (US 2004/0078757). 
Thames et al. (US 2004/0199516). 
Bargeron et al. (US 2004/0205542). 
Aarskog (US 2005/0108001). 
Bargeron et al. (US 2006/0080598). 
Wakeam et al. (US 2006/021 81 71 ). 

1 2. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Cong-Lac Huynh whose telephone number is 571-272- 
4125. The examiner can normally be reached on Mon-Thurs (9:00-7:00). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Stephen Hong can be reached on 571-272-4124. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status infomnation for unpublished applications is available through Private PAIR only. 
For more infonnation about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




Cong^Lac Huynh 
Primary Examiner 
Art Unit 2178 
2/14/07 



